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Abstract. This study aims to synthesize 

the research findings on the effects of K-12 
invention education regarding creativ- 

ity, attitudes toward invention, attitudes 
toward science, and tendency for techno- 
logical problem solving in South Korea. 
Meta-analyses were conducted by calculat- 
ing the effect size of 37 studies, including 
theses and journal papers associated with 
the implementation of invention education, 
published in South Korea. The overall effect 
size was medium (0.694), and invention 
education was found to have an effect on 
education. The effect sizes determined by 
the dependent variables and the cat- 
egorical variables indicated that invention 
education had a positive impact. In other 
words, invention programs have helped im- 
prove K-12 students’ creativity, attitudes to- 
ward science, and tendency for technologi- 
cal problem solving. However, the number 
of program sessions and participants in 
invention programs did not have an impact 
on the benefits of invention education. Con- 
sidering the effects of invention education 
on the students’ perspectives, this study 
could be helpful to both K-12 educational 
researchers and practitioners in the fields of 
science and technology education. Further 
studies are needed to develop the con- 
crete instructional strategies of invention 
education for K-12 science and technology 
classrooms. 
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Introduction 


Inventions are the driving force behind the convenient lives that 
people enjoy today. As a result, the importance of invention is increasing. 
As intellectual property rights obtained for inventions determine national 
competitiveness, many countries around the world are competing to secure 
more intellectual properties. As the phrase “patent war” suggests, different 
countries are in a fierce battle for invention. The only way to win this battle 
is to create high added value by fostering a workforce that can quickly grasp 
new social contexts and creatively solve problems. 

For that reason, attempts have been made to teach invention to K-12 
(K-12 isa shortening of kindergarten through twelfth grade) students. In the 
early days of invention education, experts debated whether it was possible 
to teach invention to students. Shlesinger (1980, p. 572) argued, “If people 
including children could be taught, for example, how to play a musical instru- 
ment, why couldn't they be taught to invent?” 

Through the invention education program, students experience hands- 
on activities (McCormack, 1984; Plucker & Gorman, 1999; Saxon, Treffinger, 
Young, & Wittig, 2003) and team-based problem-solving strategies (Gorman 
& Robinson, 1998; Gorman, Richards, Scherer, & Kagiwada, 1995; Plucker & 
Gorman, 1999; Saxon et al., 2003). These invention activities positively af- 
fect students’ inventing ability (Carlson & Gorman, 1990; Plucker, 2002; Rule, 
Baldwin, & Schell, 2009; Westberg, 1996; Wongkraso, Sitti, & Piyakun, 2015), 
creativity (Kuehn & Krockover, 1986; McCormack, 1984; Rule et al., 2009; Saxon 
et al., 2003; Wongkraso et al., 2015), attitude or interest toward particular 
subjects (Kuehn, 1985; Kuehn & Krockover, 1986; Rule et al., 2009; Shlesinger, 
1982), and motivation to learn particular subjects (Gorman, Plucker, & Cal- 
lahan, 1998; Shlesinger, 1982). 
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Despite the positive effect of invention education, few studies related to invention education have been pub- 
lished in international journals. Westberg (1996) noted, “Although educators, psychologists, and inventors believe 
in the value of instruction in inventing for students and society, research investigations of this topic have been 
infrequent and limited” (p. 256). Plucker and Gorman (1999) stated that “published research on efforts to improve 
children’s inventive skills, especially at the secondary level, is almost nonexistent” (p. 141). In another recent study, 
Wongkraso et al. (2015) observed that “these studies have been researched very little among secondary school stu- 
dents for teaching invention” (p. 523). Throughout the world, teaching invention to K-12 students is uncommon. 

In contrast to the lack of research on invention education around the world, in South Korea, studies on the 
topic have been actively conducted and published in Korean journals. According to Lee (2015), there were only 
12 studies (8.7%) on invention education for infants and K-12 students between 1992 and 2004, but the number 
increased to 61 (44.2%) between 2005 and 2009 and to 138 (65.4%) between 2010 and 2014. The active research 
on invention education in South Korea can be explained by the fact that invention became part of the national 
middle school curriculum in 2010 and has been included in the national primary school curriculum since 2014 
(National Curriculum Institute Center, 2015). Invention has become an important learning content of the national 
curriculum in South Korea. 

Readers who are not familiar with the concept of invention education may ask what educational effects it has 
on K-12 students. This can be a difficult question to answer, considering the insufficient amount of research on the 
subject in international journals. However, in South Korea, many studies and measurements related to invention 
education have already been conducted; these can help answer the question above. This study aims to verify the 
effect of invention education in South Korea by using meta-analysis. Meta-analysis methods have been widely used 
to synthesize findings of prior studies and draw an objective conclusion on the effectiveness of an intervention 
(Borenstein, Hedges, Higgins, & Rothastein, 2009). 

Lee (2015) described the trends of invention education in South Korea based on prior studies, while Kwon and 
Lee (2014) identified the effects of invention education on students’ creativity. However, these studies merely re- 
viewed previous studies and did not include a comprehensive discussion on the effects of invention education. 

Therefore, this study aims to synthesize the effects of invention education for K-12 students in South Korea 
through meta-analysis. This study is an attempt to synthesize findings of previous research on invention education 
to measure the overall effect size and compare the effects of variables that can influence the effects of invention 
education. Prior studies have indicated that invention is an important educational topic in science and technology 
subjects (Plucker & Gorman, 1999; Rule et al., 2009; Westberg, 1996). Therefore, this study will provide confirmed 
evidence on valuable effects of invention education for researchers and science or technology teachers who wish 
to design or implement effective invention education programs in the future. 

This study focuses on the following research questions: 

1. What is the overall effect size of invention education? 

2. What is the effect size of invention education according to categorical variables (creativity, attitude 
toward invention, attitude toward science, technological problem solving, activities, grade, class type, 
subject, publication)? 

3. What is the effect size of invention education according to continuous variables (number of sessions, 
number of students)? 


Theoretical Background 
Invention Education for K-12 


It is vital to understand that world history is based on invention (Kuehn & Krockover, 1986). If students can 
understand the importance of invention, they can also better understand human history and predict the future 
more reliably. For this reason, diverse attempts have been made to enable K-12 students to access invention. 

Saxon et al. (2003) introduced Camp Invention® for students to experience invention in a camp. Camp Inven- 
tion® is a large event in which over 400 students across the nation participate and perform interesting invention 
activities by combining science, history, mathematics, art, and other subjects in U.S. These activities help students 
understand academic subjects and develop teamwork. 

Invention competitions also provide students with a good opportunity to access invention. In the 1980s, 
Japan produced more creative patents than the United States as a result of the “Exhibition of the Contests on 
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School Children’s Inventions,’ which began in 1941 (Sakamoto, 1989). Students were motivated to engage in 
creative activities while preparing for and participating in this competition, and the motivation later led to numer- 
ous patents in Japan (Sakamoto, 1989). Smaller invention competitions have also been introduced. Yoon (2008) 
organized invention contests at the end of each semester so that students would review what they had learned 
during the semester in U.S. These contests were thought to enable students to experience the process of invention 
and develop their ideas further. Some invention competitions were based on simple machines. Hadi-Tabassum 
(1997) suggested that Goldberg machine competitions can help students develop a sense of cooperation or high 
level problem-solving skills. 

In addition to camps and competitions, other attempts have been made to teach invention to students. Sh- 
lesinger (1982) proposed a step-by-step program for teaching invention to students. Teachers reported increased 
interest in science and history among students who participated in the program. McCormack (1984) recom- 
mended an instructional model for teaching invention. In his quasi-experimental study among primary school 
students, he found that creativity, problem-solving skills, and attitude toward science positively increased in the 
experimental group. Kuehn and Krockover (1986) investigated that inventing instruction affected creativity skills 
and attitudes toward science in primary school students. They found no significant difference in attitudes toward 
science and creativity skills between the experimental group and control group but a significant difference in the 
measure of inventiveness. Westberg (1996) found that classes that induce interest in invention at the beginning 
motivated students to invent. She reported that her program increased the number of inventions made by the 
students but did not improve the quality of inventions. Rule et al. (2009) conducted inventing activities based on 
animal analogies and the SCAMPER (Substitute, Combine, Adapt, Modify, Put to another use, Eliminate, Reverse) 
technique. They checked the invention content score and creativity score each week; these scores were higher in 
the experimental group than in the comparison group. Wongkraso et al. (2015) conducted classes based on an 
invention learning approach for secondary students who chose a science course. The results showed a significant 
increase in the students’ inventing ability. 

These studies imply that invention education for students can be conducted as part of school education as 
well as in other forms. According to previous research, variables that can be influenced by invention education for 
K-12 students include inventing ability, creativity, and motivation or attitude toward academic subjects. 


Science-Technology Curriculum and Invention Education in South Korea 


In South Korea, the same national curriculum is applied to all students from the first grade to the ninth grade. 
During these years, students are required to complete certain courses. One of the most significant recent changes 
in the Korean curriculum was the inclusion of invention in the national science-technology cluster curriculum. 
Since 2010, seventh-grade students have been learning invention as part of their school education. The curriculum 
includes invention under topics such as “Meaning and Value of Invention,“ The Procedure from Invention to Patent,’ 
“Understanding Various Inventing Techniques,’ and “Specifying Ideas for Invention.’ The revised curriculum further 
emphasizes the subject of invention and includes it in the regular curriculum not only for middle school educa- 
tion but also for primary and high school education. Based on the revised curriculum, invention is now taught to 
primary students under topics such as “Relationship between Technology and Invention,’“Inventing Techniques 
and Ideas,” and “Make Creative Household Goods.’ Invention is also taught to middle school students under topics 
such as “Producing and Materializing Ideas,’ “Divergent Thinking Skills,” and “Convergent Thinking,’ as well as to 
high school students under topics such as “Technological Innovation and Invention” and “Patent” (National Cur- 
riculum Information Center, 2015). 

As the importance of invention becomes increasingly recognized in South Korea, research on invention edu- 
cation has also increased. In South Korea, 211 studies related to invention in preschool, primary, and secondary 
education were published between 1992 and 2014, 199 studies (94.3%) of which were conducted in the last 10 
years (Lee, 2015). Moreover, 64 studies (30.3%) of these studies are related to the science-technology curriculum, 
whereas 159 studies (75.4%) did not specify specific subjects. 

Researchers in South Korea have also used meta-analysis to examine the effects of invention education. Kwon 
and Lee (2014) performed a meta-analysis on the effects of invention education on creativity. Their results showed 
that the overall effect size of invention education on creativity was .652, which is a medium effect size. 

The literature review suggests that invention education is being actively researched in South Korea. Some 
studies investigated part of the effects of invention education, while others looked into the overall trends in inven- 
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tion education. However, there is no comprehensive research on the effects of invention education on specific 
variables; therefore, it is necessary to investigate the subject. 


Methododology of Research 
Subjects 


In this study, theses and academic journal articles on invention education published between 2002 and 2015 
in South Korea were used as subjects for a meta-analysis of the effect size of invention education. The data were 
collected using the National Assembly Digital Library (http://www.dlibrary.go.kr), Research Information Sharing 
Service (http://www.riss.kip, and DBpia (http://www.dbpia.co.ki), among other tools. A total of 2,380 theses and 
2,163 journal articles were found by searching “invention,’84 theses and 158 journal articles were found by searching 
“TRIZ,’and 14,089 theses and 20,983 journal articles were found by searching “innovation.” From the search results, 
this study selected 127 theses and 218 journal articles related to invention education for primary and secondary 
schools. From these studies, this study excluded those that were irrelevant to verifying the effects, such as qualitative 
research, correlation research, and comparative studies, and finally selected 37 papers for meta-analysis. Studies 
that proposed multiple results from different levels of school were analyzed to separate results. For the theses that 
were also published in academic journals, this study selected only the journal article versions. 


Analysis 


This study reviewed 37 papers and identified meaningful categories for coding. Gender was excluded because 
gender was mixed in all the studies. This study finalized key categories such as dependent variables, activity type, 
grade, class type, giftedness, publication, number of sessions, and number of students. These variables were coded 
by two experts of invention education and one meta-analysis expert. When they disagreed on the analysis, the 
experts discussed and decided on the code together. 

The effect size was measured using the standardized mean difference effect size (d) proposed by Borenstein 
et al. (2009). In meta-analysis, studies that include more cases are assumed to be more accurate than those with 
fewer cases. In this study, weight was applied according to the method proposed by Hedge and Olkin (1985). The 
effect size found in the meta-analysis results was interpreted according to the criteria presented in Table 1, which 
is the interpretation criteria proposed by Cohen (1977). 


Table 1. Interpretation of Effect Size. 


Small effect size Medium effect size Large effect size 
<.20 .20 ~ .80 > .80 
Homogeneity Test 


A homogeneity test was performed using the test formula proposed by Borenstein et al. (2009), based on the 
assumption that individual findings used for analysis were collected from the same population. As shown in Table 
2, the effect sizes obtained from the subjects were heterogeneous (Q = 156.776, p < .05, I?= 66.194). Therefore, in 
this study, the random-effects model was used to compare the effect sizes. The data were processed using Com- 
prehensive Meta-Analysis 2. Meta-ANOVA was conducted to examine the effect sizes according to sub-factors, and 
meta-regression was used to look into the linear relation with variables. 


Table2. §Theresult of homogeneity test(Q). 


Q-value df(Q) p-value P 


156.776 53 0.000 66.194 
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Publication Bias Test 


To secure the internal validity of the meta-analysis results, this study conducted a publication bias test, which 
can be analyzed in various ways. First, when using rank correlation as proposed by Begg and Mazumdar (1994), 
there was no significant correlation (tau = 0.36, p > .05). Second, a degree of left-right symmetry was found when 
this study examined the distribution of effect sizes based on the funnel plot. Based on these results, this study 
could not find a publication bias in the subjects of this study. 


Results of Research 
Overall Effect Size 
Table 3 shows the results of meta-analysis on the educational effects of invention education. This study in- 
cluded a total of 37 papers and 54 effect sizes. The overall effect size was 0.694, and the 95% confidence interval 


was between 0.588 and 0.801. According to the effect size interpretation criteria proposed by Cohen (1977), the 
overall effect size was medium. 


Table3. § Theresult of meta-analysis on the educational effects. 
Number Studies Q-value p-value E.S. 95% Cl Standard Error 


04 156.776 <.05 0.694 0.588 ~ 0.801 0.033 


Effect Size According to Categorical Variables 


Table 4 shows the effect sizes according to the dependent variables. The effect size for creativity (0.743) 
was the largest, followed by attitudes toward invention (0.689), attitudes toward science (0.686), and tendency 
for technological problem solving (0.444). According to the effect size interpretation criteria proposed by Cohen 
(1977), invention education had a medium effect size on all the dependent variables. 


Table 4. Effect size by dependent variables. 


Outcomes Pale Q-value p-value E.S. 95% Cl aids 
Creativity 32 112.749 <.05 0.743 0.591 ~ 0.895 0.055 
Attitudes toward invention 19 26.466 <.05 0.689 0.522 ~ 0.856 0.041 
Attitudes toward science 2 1.686 <.05 0.686 0.213 ~ 1.158 0.167 
Technological problem-solving 3) 10.166 <.05 0.444 0.147 ~ 0.741 0.081 


Table 5 shows the effect size according to the categorical variables. The effect size according to the activity type 
was largest in non-hands-on (0.703) and hands-on (0.691) activities, while the effect size according to the school 
level was largest in primary school (0.723), followed by high school (0.709) and middle school (0.530). According to 
class type, the effect size was largest in the regular class (0.836), followed by the discretion class (0.698) and camp 
(0.610). The effect size according to subjects was larger among general students (0.703) than among gifted students 
(0.635). The effect size according to publication was larger in theses (0.734) than in academic journals (0.667). Ac- 
cording to Cohen's (1977) effect size interpretation criteria, the effect size on all the variables was medium. 
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Table 5. 


Category 


Activity type 


School 
grade 


Class type 


Subject 


Publication 


Sub-Category 


Non hand-on 
Hand-on 
Primary school 
High school 
Middle school 
Regular class 
Discretion class 


Camp 


General 
students 


Gifted students 


These 


Academic 
journals 


Number 
Studies 


17 


37 


45 


13 


20 


48 


23 


31 


Effect Size According to Continuous Variables 


Effect size by categorical variables. 


Q-value 


40.516 


115.042 


146.826 


0.398 


1915 


19.615 


48.424 


76.385 


141.134 


13.246 


46.881 


105.756 


p-value E.S. 
< 05 0.703 
<.05 0.691 
<.05 0.723 
<.05 0.709 
<.05 0.53 
<.05 0.836 
<.05 0.698 
<.05 0.61 
<.05 0.703 
<.05 0.635 
<.05 0.734 
<.05 0.667 


95% Cl 


0.523 ~ 0.884 


0.559 ~ 0.823 


0.598 ~ 0.848 


0.395.~ 1.022 


0.347 ~ 0.714 


0.642 ~ 1.030 


0.537 ~ 0.859 


0.431 ~ 0.789 


0.586 ~ 0.821 


0.360 ~ 0.910 


0.580 ~ 0.888 


0.524 ~ 0.810 
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Standard 
Error 


0.051 


0.043 


0.072 


0.035 


0.043 


0.051 


0.044 


0.06 


0.036 


0.076 


0.042 


0.047 


Meta-regression was performed to examine linear relationship with the number of sessions and students. 
The results are shown in Table 6. 


Table 6. Effect size by continuous variables. 
Category Covariate Coefficient 

intercept 0.8828 

Number of sessions 
slope -0.0119 
intercept 0.7687 

Number of students 
slope -0.0016 


Standard Error 


0.1194 
0.0067 
0.093 
0.0016 


z-value 


7.39 
-1.77 
8.26 
-0.98 


p-value 


0.0762 
0 
0.3272 


The gradient according to the number of sessions in the program was —0.0119 (p > .05), while the gradient 
according to the number of students was —0.0016 (p > .05). Neither of the gradients was statistically significant. 


Discussion 


This study provided a comprehensive and systematic analysis of research related to invention education 
in South Korea, and it attempted to suggest the ways in which invention education impacts the educational 
experience of students. Meta-analysis was performed based on the standardized mean difference effect size. This 
section presents a discussion of the findings. 

First, the overall effect size of invention education was medium (0.694) in South Korea. This indicates that the 
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findings of this study are consistent with those of prior studies in that invention education affects creativity (Kuehn, 
1985; Kuehn & Krockover, 1986; McCormack, 1984), attitudes towards, or interest in a subject (Plucker & Gorman, 
1999; Rule et al., 2009; Westberg, 1996), as well as the students’ inventing ability (Shlesinger, 1980; Westberg, 
1996; Wongkraso et al., 2015). Invention education can be a powerful approach for improving students’ creativity 
and attitudes toward science and technology. Educational policymakers or curriculum designers should include 
invention education content or processes in their educational agenda by considering the benefits of invention 
education in the areas of science and technology education. 

Second, the effect size based on dependent variables was greatest for creativity (0.743), followed by attitudes 
toward invention (0.689), attitudes toward science (0.686), and tendency for technological problem solving (0.444). 
The effect size of invention education based on dependent variables was medium. Most invention education 
programs are believed to have a positive effect on creativity, as they are implemented with diverse thinking skills, 
problem-solving activities, and hands-on experiences to create new solutions or strategies. The results of this 
study support those of Kwon and Lee (2014), whose meta-analysis showed that invention education has a posi- 
tive educational effect on creativity. In addition, attitudes towards invention or science had a medium effect size. 
Positive attitudes toward science and invention may have been formed as students used scientific knowledge to 
solve the problems they were assigned in invention education. However, only two effect sizes were used to analyze 
the attitudes toward science. 

Third, with respect to the effect size based on categorical variables, non-hands-on activities (0.703) had a slightly 
larger effect size than hands-on activities (0.691). Although hands-on activities are generally believed to improve 
inventing ability, this study found that invention programs based on reading, writing, and thinking techniques also 
have similar educational effects. The majority of research focuses on hands-on activities; therefore, further research 
needs to be conducted on non-hands-on activities. The effect size based on the school level was largest in primary 
school (0.723), followed by high school (0.709) and middle school (0.530). As suggested by the number of cases 
in the meta-analysis, most of the studies focused on primary school education. For years, researchers have been 
investigating the various invention education methods used in primary schools, and the accumulated knowledge 
is likely to improve the educational effects of invention education. While the effect size was also relatively large in 
high school, it is important to note that only two cases were involved in the interpretation. Although invention is 
included in the middle school curriculum, only seven cases were found in middle school, and the effect size was 
small. Further research needs to be conducted on effective ways to teach invention in middle schools. The effect size 
according to the class type was largest in the regular class (0.836), followed by the discretion class (0.698) and camp 
(0.610). This finding suggests that invention can be taught more effectively when combined with other academic 
subjects than when it is taught separately. South Korea promotes convergence education as a policy, and integrating 
invention into various academic subjects is expected to have a positive effect on different subjects. Moreover, the 
sections related to invention that were included in the science-technology curriculum in South Korea can create 
synergy in secondary education. In terms of educational subjects, the effect size was larger among general students 
(0.703) than among gifted students (0.635). The results of this study showed that invention education had a slightly 
stronger educational effect on general students who previously did not have access to invention programs. This 
finding supports the results of a study conducted by Choi (2014) who argued that anyone who has an interest in 
and passion for invention can develop their inventing ability through education and training, and that invention 
is not exclusive to those who have a special talent for it. Hence, invention is a subject that can be embraced by 
all K-12 students, and invention education must be expanded and globally implemented. The effect size based 
on type of publication was larger in theses (0.734) than in academic journals (0.667). This finding contradicts that 
of Ragosta (2010), who suggested that academic journal articles generally have a larger effect size than theses. 
Further research is needed in order to investigate the reason for this contradiction. 

Fourth, in terms the continuous variables, the number of sessions and students in the programs did not have 
a Significant impact on the effect size. Prior studies reported that there was no clear correlation between the effect 
size and the number of program sessions (Bellini, Peters, Benner, & Hopf, 2007; Ekers, Richars, & Gilbody, 2008). This 
finding suggests that the selection of programs in invention education is more important than the duration of 
those programs. However, invention programs should be implemented with the smallest number of participants 
as possible because they rely on hands-on and/or design activities (Kroesbergen & Van Luit, 2003). 
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Conclusions 


This study confirmed the effects of invention education for primary and secondary students using meta- 
analyses. In particular, invention education was found to have an educational effect on students’ creativity, attitudes 
toward invention, attitudes toward science, and tendency for technological problem solving. Based on these find- 
ings, the educational community in STEM education fields should pay careful attention to invention education. 
Globally, science education researchers have conducted initial studies related to invention education (Kuehn & 
Krockover, 1986; McCormick, 19984; Shlesinger, 1982), but, until recently these types of studies have been rare in 
this field (Wongkraso et al., 2015). 

This study proposes several topics for future research. First, while this study confirmed the benefits of invention 
education regarding K-12 students’ perspectives, further studies are needed to address practical considerations 
for practitioners and policymakers. Second, in this study, the meta-analysis was conducted using the standardized 
mean difference effect size, assuming that the variables are mutually independent. Because the variables could 
possibly influence one another, multilevel meta-analysis should be conducted by controlling the levels of influence 
that different variables could exert. 
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